A Hearer-Oriented Evaluation of Referring Expression Generation
نویسندگان
چکیده
This paper discusses the evaluation of a Generation of Referring Expressions algorithm that takes structural ambiguity into account. We describe an ongoing study with human readers.
منابع مشابه
Effects of Cognitive Effort on the Resolution of Overspecified Descriptions
Studies in referring expression generation (REG) have shown different effects of referential overspecification on the resolution of certain descriptions. To further investigate effects of this kind, this article reports two eye-tracking experiments that measure the time required to recognize target objects based on different kinds of information. Results suggest that referential overspecificati...
متن کاملGenerating Contrastive Referring Expressions
The referring expressions (REs) produced by a natural language generation (NLG) system can be misunderstood by the hearer, even when they are semantically correct. In an interactive setting, the NLG system can try to recognize such misunderstandings and correct them. We present an algorithm for generating corrective REs that use contrastive focus (“no, the BLUE button”) to emphasize the informa...
متن کاملGeneration of effective referring expressions in situated context
In task-oriented communication, references often need to be effective in their distinctive function, that is, help the hearer identify the referent correctly and as effortlessly as possible. However, it can be challenging for computational or empirical studies to capture referential effectiveness. Empirical findings indicate that humanproduced references are not always optimally effective, and ...
متن کاملThe Use of Spatial Relations in Referring Expression Generation
There is a prevailing assumption in the literature on referring expression generation that relations are used in descriptions only ‘as a last resort’, typically on the basis that including the second entity in the relation introduces an additional cognitive load for either speaker or hearer. In this paper, we describe an experiemt that attempts to test this assumption; we determine that, even i...
متن کاملCombining symbolic and corpus-based approaches for the generation of successful referring expressions
We present an approach to the generation of referring expressions (REs) which computes the unique RE that it predicts to be fastest for the hearer to resolve. The system operates by learning a maximum entropy model for referential success from a corpus and using the model’s weights as costs in a metric planning problem. Our system outperforms the baselines both on predicted RE success and on si...
متن کامل